iReasearch学术科研网

摘要：This study investigated (a) the lexical demands of academic spoken English and (b) the coverage of the Academic Word List (AWL) in academic spoken English. The researchers analyzed the vocabulary in 160 lectures and 39 seminars from four disciplinary sub-corpora of the British Academic Spoken English (BASE) corpus: Arts and Humanities, Life and Medical Sciences, Physical Sciences and Social Sciences. The results showed that knowledge of the most frequent 4,000 word families plus proper nouns and marginal words provided 96.05% coverage, and knowledge of the most frequent 8,000 word families plus proper nouns and marginal words provided 98.00% coverage of academic spoken English. The vocabulary size necessary to reach 95% coverage of each sub-corpus ranged from 3,000 to 5,000 word families plus proper nouns and marginal words and 5,000 to 13,000 word families plus proper nouns and marginal words to reach 98% coverage. The AWL accounted for 4.41% coverage of academic spoken English. Its coverage in each sub-corpus ranged from 3.82% to 5.21%. With the help of the AWL, learners with knowledge of proper nouns and marginal words will need a vocabulary of 3,000 and 8,000 word families to reach 95% and 98% coverage of academic spoken English, respectively. [Copyright The American University; published by Elsevier Ltd.]

摘要：The extent to which risk for French as a second language (L2) reading and language learning impairment are distinct and can be predicted using first language (L1) predictors was examined in English-speaking students in total French immersion programs. A total of 86 children were tested in fall of kindergarten, spring kindergarten, and spring Grade 1 using an extensive battery of L1 predictor tests (in kindergarten) and L2 outcome tests (in Grade 1). Analyses of the kindergarten predictor scores revealed distinct underlying components, one related to reading and one to oral language. Further analyses revealed that phonological awareness, phonological access, and letter-sound knowledge in L1 were significant predictors of risk for reading difficulties in L2 while performance on L1 sentence repetition, phonological awareness, and tense marking tests in kindergarten were the best predictors of risk for L1 and L2 oral language difficulties. Both fall- and spring-kindergarten predictors predicted Grade 1 outcomes to a significant extent, with the spring-kindergarten predictors being more accurate. These results provide support for distinctive risk profiles for L2 oral language and reading difficulty and, furthermore, argue that assessment of L1 abilities can be used to make reasonably accurate predictions of later reading and/or oral language learning difficulties in L2 students. Adapted from the source document

摘要：In spoken French, the phonological processes of liaison and resyllabification can render word and syllable boundaries ambiguous (e.g., un air 'an air'/un nerf 'a nerve,' both [.nE]). Production data have demonstrated that speakers of French vary the duration of consonants that surface in liaison environments relative to consonants produced word initially. Further research has suggested that listeners exploit these durational differences in the processing of running speech, although no study to date has directly tested this hypothesis. The current study examines the exploitation of duration in word recognition processes by manipulating this single acoustic factor while holding all other factors in the signal constant. The pivotal consonants in potentially ambiguous French sequences (e.g., /n/ in un nerf) were instrumentally shortened and lengthened and presented to listeners in two behavioral tasks. The results suggest that listeners are sensitive to segmental duration and use this information to modulate the lexical interpretation of spoken French. Adapted from the source document

摘要：This study, which is part of a large-scale study of using objective measures to validate assessment rating scales and assessment tasks in a high-profile school-based assessment initiative in Hong Kong, examined how grammatical complexity measures relate to task type and analytic evaluations of students' speaking proficiency in a classroom-based assessment context. An in-depth analysis of oral performance on two different assessment tasks (i.e., monologic vs. interactive) from 30 English as a Second Language, Cantonese-mother-tongue, secondary school students was conducted using a range of measures of grammatical complexity derived from the previous second language (L2) speaking and writing studies. Results showed that the individual presentation task tended to promote not only a greater number of T-units, clauses, verb phrases, and words but also longer T-units and utterances, thus probably stretching learners more in terms of complexity of grammatical and lexical processing. Results also showed that complexity measures recommended as among the most useful complexity measures demonstrated no significant correlations with analytic ratings of learner speaking proficiency. These findings were then discussed in light of the complex, dynamic, and developmental nature of grammatical complexity as well as in light of a learner-, task-, and L2 form-sensitive account of L2 oral production. Adapted from the source document

摘要：This case study discusses the development and use of an oral performance assessment instrument intended to evaluate Filipino agents' customer service transactions with callers from the United States (US). The design and applications of the instrument were based on a longitudinal, qualitative observation of language training and customer service support practices of Philippine-based agents employed by a US-owned call centre company. Although language training in Philippine call centers continues to improve (Lockwood, 2012), there are still clear limitations to how the oral performance of Filipino agents is evaluated internally by call centre companies. Specialized assessment instruments, following ESP/EOP norms, broadly used by the industry are still relatively untested and many call centers maintain their own metrics that often measure agents' language use and service quality separately (Friginal, 2007, 2009). In this study, the assessment instrument was adapted from the Melbourne Medical Students' Diagnostic Speaking Scale (Grove & Brown, 2001) and further developed to include ESP/EOP approaches in this context of inter-cultural communication. A conveniently sampled set of recorded calls (N = 100) across different task categories (e.g., troubleshooting interactions, product inquiry) was used to test the instrument for initial reliability measures. Results and analysis of the instrument's context suitability and limitations are discussed below. [Copyright The American University; published by Elsevier Ltd.]

摘要：This article reports on the design and use of a profiler for lexical sophistication (i.e., use of advanced vocabulary), which was created to assess the lexical richness of intermediate and advanced Swedish second language (L2) learners' French and Italian. It discusses how teachers' judgments (TJs) of word difficulty can contribute to the methodology for lexical profiling and compares two methods, one purely frequency based and one modified on the basis of TJs of word difficulty. It has been suggested elsewhere that factors other than frequency play an important role in vocabulary acquisition. Here it is argued that cognates and thematic vocabulary related to teaching materials, although infrequent in target language (TL) corpora, should not necessarily be considered advanced and that analyses of learners' lexical sophistication would benefit from integrating these aspects. In this study, the frequency-based method normally used in lexical profiling was modified by recategorizing some low-frequency words considered easy by many teachers. On the basis of the TJs, a basic vocabulary, which consisted mainly of high-frequency words but also of cognates and thematic words, was defined, which was based on the fact that teachers judged certain low-frequency cognates and thematic words as relatively easy. Using the modified method, learners' lexical profiles were found to be more homogeneous within groups of learners at specific proficiency levels. The superiority of the new method over the purely frequency-based one was shown when comparing effect sizes. It is argued that this method gives a more correct picture of advanced L2 lexical profiles. Adapted from the source document

摘要：This study presents an investigation of oral narratives collected from heritage Egyptian and Palestinian Arabic speakers living in the United States. The focus is on a number of syntactic and morphological features in their production, such as word order, use of null subjects, selection of prepositions, agreement, and possession. The degree of codeswitching in their narratives was also investigated. The goal was to gain some insights into the Arabic linguistic competence of this group of speakers. The results show that although Arabic heritage speakers display significant competence in their heritage colloquial varieties, there are gaps in that knowledge. There also seems to be significant transfer from English, their dominant language. Adapted from the source document

摘要：Despite the spread of reliable desktop audio and videoconferencing facilities, some CMC-based projects still rely on asynchronous written environments, if only because of the temporal constraints of synchronicity (Guichon, 2009; Develotte, Guichon & Vincent, 2010). Yet speaking is usually the skill students most need to improve when learning a second language (L2). This paper therefore sets out to measure the impact of distant written exchanges between Native Speakers (NS) and Non Native Speakers (NNS) on the development of NNS L2 oral output, focusing specifically on the effect of phonological nativisation. The context of this study is a teacher training programme for future primary school teachers in France. During their L2 course aiming to help them improve their mastery of English, they were given the opportunity to take part in a CMC-based project with PGCE (Postgraduate Certificate in Education) students from King's College, London. Action research was thus carried out to examine the potential of this project in the development of the participants' L2 oral output. The L2 course being task-oriented, the trainee teachers' L2 oral output was evaluated by means of pre- and post-tests based on tasks. The results show that stability prevails over progress, which is in keeping with the fact that interlanguage development is a long process (Chapelle, 2003: 119). The results also confirm the importance of phonological nativisation when learners have access only to written authentic input. Adapted from the source document

摘要：French learners at university meet difficulties in the comprehension of oral English. Being in a formal context of language learning, they need to develop language awareness to compensate for insufficient exposure to the English language. To meet the students' needs, data was collected in order to pinpoint the main errors made by French learners in listening tasks. The errors were then analyzed and put into perspective with the system of oral English; a connection clearly appeared between the errors and what is barely heard or cannot be heard in reference to written English, hinting at what could cause poor oral comprehension. Three areas of knowledge appeared to be missing in the students' background: the links between morpho-syntax and phonology, the mastery of phonological data found in dictionaries and the possible recourse to strategies in order to compensate for what has not been heard properly. These issues were addressed in an on-line program designed for non-beginners of English at university. This paper deals with the assessment of the progress made by users of the program in a formal learning situation. Two groups of learners were considered: students whose major is English, and students for whom the study of English is optional. Two series of tests were implemented, before and after the use of the program. The tests focused on the ability of learners to read IPA transcription, to count syllables in oral English, and to pronounce auxiliaries and prepositions in different contexts. The results to be discussed establish that the two groups of learners significantly improved their knowledge of oral English. Of particular interest is the fact that, even if the two groups had significantly different knowledge of oral English before using the program, with non-specialists of English having poorer knowledge, the two groups obtain similar results on the post-test, showing greater progress on the part of the non-specialists. All learners appear to improve dramatically their knowledge of IPA and their ability to use it. The progress measured by the tests was corroborated by other modes of assessment: a survey on the students' judgment as regards the usefulness of the program, and individual interviews focusing on what the students recall from the content of the program. In the latter, the students used relevant meta-linguistic and meta-cognitive expressions, showing their ability for further progress in developing listening abilities in English as a Second Language (ESL). Adapted from the source document

摘要：Oral communication ability has become increasingly important to many EFL students. Several commercial software programs based on automatic speech recognition (ASR) technologies are available but their prices are not affordable for many students. This paper will demonstrate how the Microsoft Speech Application Software Development Kit (SASDK), a free but powerful tool, can be used to develop an oral skills training website for EFL students. This ASR-based website offers six different types of online exercises which allow students to practise their oral skills and obtain immediate feedback on their performance. A group of 25 college students and a group of 35 pre-service English teachers were invited to use the website. Two surveys were conducted to investigate the students' and the pre-service teachers' perceptions of this site. The results indicated that most teachers and students enjoyed using this website, which they felt could help improve their English oral skills. They also pointed out that the main strength of the ASR-based learning system is that it offers several different types of exercises which can encourage learners to produce more output in a low-anxiety environment. The major limitations of the website are the insufficient feedback and the challenging standards one must meet in order to achieve a pass mark. These findings can be useful for teachers who are interested in using ASR in teaching and for CALL researchers who aim to develop better ASR-based systems for language learning. Adapted from the source document

摘要：Performance on integrated tasks requires candidates to engage skills and strategies beyond language proficiency alone, in ways that can be difficult to define and measure for testing purposes. While it has been widely recognized that stimulus materials impact test performance, our understanding of the way in which test takers make use of these materials in their responses, particularly in the context of listening-speaking tasks, remains predominantly intuitive. Recent studies have highlighted the problems associated with content-related aspects of task fulfilment on integrated tasks, but little attempt has been made to operationalize the way in which content from the input material is integrated into speaking performances. Using discourse data from a trial administration of a pilot for an Oxford English language test, this paper investigates how test takers integrate stimulus materials into their speaking performances on an integrated listening-then-speaking summary task, whether these behaviours are reflected in the relevant rating scale and, by implication, whether the test scores assigned according to this scale reflect real differences in the quality of oral performances. An innovative discourse analytic approach was developed to analyse content-related aspects of performance in order to determine if such aspects represent an appropriate measure of the speaking ability construct. Results showed that the measures devised, such as the number of key points included from the input text, and the accuracy with which information was reproduced or reformulated, effectively distinguished participants according to their level of speaking proficiency. The study's findings support the use of this particular task-type and the appropriateness of the associated rating scale as a measure of speaking proficiency, as well as the utility of the devised discourse-based measures for the validation of integrated tasks in other assessment contexts. [Reprinted by permission of Sage Publications, Ltd., copyright holder.]

摘要：This paper presents a framework for incorporating the assessment of psycholinguistic constructs into spoken language proficiency testing. Although response time and automaticity of language processing are vital factors in language acquisition, as constructs they are rarely explicitly assessed in language tests. It is proposed that efficiency of processing, although it does not appear in most models of communicative language competence, might be viewed as a language competence in its own right. In contrast to communicative approaches to testing which evaluate mastery of complex language structures or domain-specific vocabulary, an approach which emphasizes efficiency of processing evaluates the speed and accuracy with which a learner processes familiar language, as this provides equally useful information about their L2 proficiency. In a study to demonstrate this, the speech of 147 test takers was evaluated as they performed on conceptually simple and straightforward performance tasks such as elicited imitation. It was found that sentence repetition and sentence building tasks reliably separated test takers according to proficiency in a way that accounts for the trade-off between fluency, accuracy and complexity. While these tasks would not be considered communicative, they are psycholinguistically valid and also link to good practice in classroom language learning activities. [Reprinted by permission of Sage Publications, Ltd., copyright holder.]

摘要：This study examines the associations between the speaking proficiency of 181 adult learners of Dutch as a second language and their linguistic competences. Performance in eight speaking tasks was rated on a scale of communicative adequacy. After extrapolation of these ratings to the Overall Oral Production scale of the Common European Framework of Reference for Languages (CEFR) (Council of Europe, 2001), 80 and 30 participants (on average per speaking task) were found to be, respectively, at the B1 and B2 levels of this scale. The following linguistic competences were tapped with non-communicative tasks: productive vocabulary knowledge, productive knowledge of grammar, speed of lexical retrieval, speed of articulation, speed of sentence building, and pronunciation skills. Discriminant analyses showed that all linguistic competences, except speed of articulation, discriminated participants at the two levels of oral production. Subsequent comparisons showed that the distance between B1ers and B2ers was smaller in knowledge of high-frequency words than in knowledge of medium- and low-frequency words. Extrapolation from scores on the vocabulary test yielded estimations of productive vocabularies of, on average, 4000 and 7000 words for B1ers and B2ers, respectively. The grammar test assessed grammatical knowledge in 10 domains. B2ers were found to outperform B1ers on all parts of the test. Thus, the differences in lexical and grammatical knowledge of B1ers and B2ers appear to be a matter of degree, rather than a matter of category or domain. The paper ends with a research agenda for a linguistic underpinning of the CEFR. [Reprinted by permission of Sage Publications, Ltd., copyright holder.]

摘要：The content that test-takers attempt to convey is not always included in the construct definition of general English oral proficiency tests, although some English-for-academic-purposes (EAP) speaking tests and most writing tests tend to place great emphasis on the evaluation of the content or ideas in the performance. This study investigated the relative contribution of linguistic criteria and the elaboration of speech content to scores on a test of speaking proficiency. A speaking test was designed and administered to Japanese undergraduates to determine what criteria English teachers associate with general oral proficiency. Nine raters were recruited to rate 30 students' monologues on three topics, using intuitive judgments of oral proficiency (referred to as Overall communicative effectiveness). Following this, they assigned scores to the monologues using five criteria: Grammatical accuracy, Fluency, Vocabulary range, Pronunciation, and Content elaboration/development. The raters were also asked to provide open-ended written comments on the factors contributing to their intuitive judgments. Statistical analyses of the scores -- Rasch measurement, multiple regression, and multivariate generalizability (G) theory analysis -- revealed that Content elaboration/development made a substantive contribution to the intuitive judgments and composite score. The present study enriches our understanding of general oral proficiency and the construct definition of proficiency tests. [Reprinted by permission of Sage Publications, Ltd., copyright holder.]

摘要：The fuzziness of assessing second language speaking performance raises two difficulties in scoring speaking performance: indistinction between adjacent levels and overlap between scales. To address these two problems, this article proposes a new approach, confidence scoring, to deal with such fuzziness, leading to confidence scores between two adjacent levels applied to three scales. Since confidence scores have to be transformed to an exact score for test interpretation and use, membership functions and rule bases are applied and a confidence scoring algorithm is developed. Confidence scoring is demonstrated in the paper by an example to facilitate easy understanding. The paper then describes a pilot study that was conducted to try out the confidence scoring design. Initial results reveal that: first, confidence scoring is as feasible as traditional scoring; second, confidence scoring performs better in scoring dependability and in correlations with established benchmarks. At the end of the article, further studies are called for in order to build a validity argument and make further revisions to the confidence scoring method described here. [Reprinted by permission of Sage Publications, Ltd., copyright holder.]

摘要：This study investigated factors that could affect inter-examiner reliability in the pronunciation assessment component of speaking tests. We hypothesized that the rating of pronunciation is susceptible to variation in assessment due to the amount of exposure examiners have to nonnative English accents. An inter-rater variability analysis was conducted on the English pronunciation ratings of three test candidate interlanguages: Chinese, Korean, and Indian English. Pronunciation was rated by 99 International English Language Testing System (IELTS) examiners across five geographically dispersed test centres. The examiners had either prolonged exposure, or no, or little exposure to the interlanguage of the candidates. A significant proportion of examiners rated pronunciation higher when they had prolonged exposure, and lower when they had no, or little, exposure to the candidates' interlanguage. The location of the test centre also had a significant effect on the pronunciation rating, independent of the familiarity variable, with a significant proportion of NNS raters scoring candidates from their home country higher than those who were not. It is recommended that interlanguage phonology familiarity should be considered in the design of speaking tests and rater training and that research is required into test centre bias and the phonological judgements and awareness of OPI raters. [Reprinted by permission of Sage Publications, Ltd., copyright holder.]

摘要：Rating scale design and development for testing speaking is generally conducted using one of two approaches: the measurement-driven approach or the performance data-driven approach. The measurement-driven approach prioritizes the ordering of descriptors onto a single scale. Meaning is derived from the scaling methodology and the agreement of trained judges as to the place of any descriptor on the scale. The performance data-driven approach, on the other hand, places primary value upon observations of language performance, and attempts to describe performance in sufficient detail to generate descriptors that bear a direct relationship with the original observations of language use. Meaning is derived from the link between performance and description. We argue that measurement-driven approaches generate impoverished descriptions of communication, while performance data-driven approaches have the potential to provide richer descriptions that offer sounder inferences from score meaning to performance in specified domains. With reference to original data and the literature on travel service encounters, we devise a new scoring instrument, a Performance Decision Tree (PDT). This instrument prioritizes what we term 'performance effect' by explicitly valuing and incorporating performance data from a specific communicative context. We argue that this avoids the reification of ordered scale descriptors which we find in measurement-driven scale construction for speaking tests. [Reprinted by permission of Sage Publications, Ltd., copyright holder.]

摘要：Drawing on current theories in personality, second-language (L2) oral ability, and psychometrics, this study investigates the extent to which self-consciousness and assertiveness are explanatory variables of L2 oral ability. Three hundred sixty first-year Japanese university students who were studying English as a foreign language participated in the study. Personality was measured with the Japanese version of the NEO-PI-R (Shimonaka, Nakazato, Gondo, & Takayama, 2002), and L2 oral ability was assessed with an institutionalized group oral discussion test in which performances were judged for pronunciation, fluency, grammar, vocabulary, and communication skills. An analysis of covariance structures technique indicated that assertiveness is a significant explanatory variable of L2 oral ability and no effect was found for self-consciousness. Communication skills and fluency were slightly better explained by assertiveness than the other subconstructs of oral ability.

摘要：Learners' ability to recognize linguistic contrasts in American Sign Language (ASL) was investigated using a paired-comparison discrimination task. Minimal pairs containing contrasts in five linguistic categories (i.e., the formational parameters of movement, handshape, orientation, and location in ASL phonology, and a category comprised of contrasts in complex morphology) were presented in sentence contexts to a sample of 127 hearing learners at beginning and intermediate levels of proficiency and 10 Deaf native signers. Participants' responses were analyzed to determine the relative difficulty of the linguistic categories and the effect of proficiency level on performance. The results indicated that movement contrasts were the most difficult and location contrasts the easiest, with the other categories of stimuli of intermediate difficulty. These findings have implications for language learning in situations in which the first language is a spoken language and the second language (L2) is a signed language. In such situations, the construct of language transfer does not apply to the acquisition of L2 phonology because of fundamental differences between the phonological systems of signed and spoken languages, which are associated with differences between the modalities of speech and sign.

摘要：The present study investigates the role of speech repetition in oral fluency development. Twenty-four students enrolled in English-as-a-second-language classes performed three training sessions in which they recorded three speeches, of 4, 3, and 2 min, respectively. Some students spoke about the same topic three times, whereas others spoke about three different topics. It was found that fluency improved for both groups during training but was maintained on post-tests only by the students who repeated their speeches. These students had used more words repeatedly across speeches, most of which were not specifically related to the topic. It is argued that proceduralization of linguistic knowledge represented a change in underlying cognitive mechanisms, resulting in improvements in observable fluency.